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DETAILED ACTION 
Claim Rejections - 35 USC § 112 

1 . The following is a quotation of the second paragraph of 35 U.S. C. 112: 

The specification shall conclude with one or more claims particularly pointing out and distinctly claiming the 
subject matter which the applicant regards as his invention. 

2. Claims 46-48 recite the limitation "said data conversion". There is insufficient 
antecedent basis for this limitation in the claims. 

Claim Rejections - 35 USC §103 

3. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

4. Claims 38, 39, 41-44, and 49-57 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over U.S. Patent No. 5,999,173 to Ubillos in view of WO 98/52356 to Chang et al 

a. Referring to claim 38, Ubillos discloses a user interface unit operable to select a 
component to be operated by a user from among the plural components and inputting 
operational contents of the selected component (column 5, lines 33-35; column 8, lines 
26-36; Fig. 4 and 5). Ubillos does not explicitly disclose a correction unit operable to 
generate a corrected stream by replacing the motion data of the selected component with 
data based on the operational contents inputted by said user interface unit and to output 
the corrected stream. Chang discloses a correction unit operable to generate a corrected 
stream by replacing the motion data of the selected component with data based on the 
operational contents inputted by said user interface unit and to output the corrected 
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stream (page 16, paragraph 4; page 18, paragraph 2; page 20, paragraph 3; page 23, 
paragraph 3). At the time the invention was made it would have been obvious to a person 
of ordinary skill in the art to modify the apparatus of Ubilios by incorporating a 
correction unit as taught by Chang. The suggestion/motivation for doing so would have 
been because it would allow editing in the compressed domain which allows users to 
manipulate a specific object without having to fully decode the video (Chang, page 5, 
paragraph 1) and it would allow users to manipulate video information over a distributed 
network (Chang, page 6, paragraph 4). 

b. Claim 39 is rejected per claim 38. Ubilios does not exphcitly disclose a stream 
data reception unit operable to receive the input stream wherein said correction unit is 
further operable to correct the input stream by replacing the motion data of the selected 
component with data based on the operational contents before outputting the corrected 
stream. Chang discloses a stream data reception unit operable to receive the input stream 
(Fig. 12; page 22, paragraph 4) wherein said correction unit is further operable to correct 
the input stream by replacing the motion data of the selected component with data based 
on the operational contents before outputting the corrected stream (page 16, paragraph 4; 
page 18, paragraph 2; page 20, paragraph 3; page 23, paragraph 3). At the time the 
invention was made it would have been obvious to a person of ordinary skill in the art to 
modify the apparatus of Ubilios by incorporating a correction unit as taught by Chang. 
The suggestion/motivation for doing so would have been because it would allow editing 
in the compressed domain which allows users to manipulate a specific object without 
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having to fully decode the video (Chang, page 5, paragraph 1) and it v^ould allow users to 
manipulate video information over a distributed network (Chang, page 6, paragraph 4). 

c. Referring to claim 41, Ubillos does not explicitly disclose a reproduction unit 
operable to decode the corrected stream, which is outputted from the correction unit, to 
reproduce the computer graphics. Chang discloses a reproduction unit operable to decode 
the corrected stream, which is outputted from the correction unit, to reproduce the 
computer graphics (Fig. 12; page 23, paragraph 4). At the time the invention was made it 
would have been obvious to a person of ordinary skill in the art to modify the apparatus 
of Ubillos by incorporating a correction unit as taught by Chang. The 
suggestion/motivation for doing so would have been because it would allow editing in the 
compressed domain which allows users to manipulate a specific object without having to 
fijUy decode the video (Chang, page 5, paragraph 1) and it would allow users to 
manipulate video information over a distributed network (Chang, page 6, paragraph 4). 

d. Referring to claim 42, Ubillos does not explicitly disclose a display unit operable 
to real-time display the computer graphics reproduced by said reproduction unit. Chang 
discloses a display unit operable to real-time display the computer graphics reproduced 
by said reproduction unit (Fig. 12). At the time the invention was made it would have 
been obvious to a person of ordinary skill in the art to modify the apparatus of Ubillos by 
incorporating a correction unit as taught by Chang. The suggestion/motivation for doing 
so would have been because it would allow editing in the compressed domain which 
allows users to manipulate a specific object without having to fully decode the video 
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(Chang, page 5, paragraph 1) and it would allow users to manipulate video information 
over a distributed network (Chang, page 6, paragraph 4). 

d. Referring to claim 43, Ubillos does not expUcitly disclose wherein said correction 
unit is operable to correct the input stream by replacing the motion data of the selected 
data with data based on the operational contents; Ubillos does not expUcitly disclose a 
user data transmission unit operable to transmit the selected components and the 
operational contents of the selected component to a second stream correction apparatus; a 
user data reception unit operable to receive a second component selected by a second user 
interface unit of the second stream correction apparatus and second operational contents 
of the second selected component; replacing motion data of the second selected 
component with data based on the second operational contents before outputting the 
corrected stream. Chang discloses correction unit is operable to correct the input stream 
by replacing the motion data of the selected data with data based on the operational 
contents (page 16, paragraph 4; page 18, paragraph 2; page 20, paragraph 3; page 23, 
paragraph 3); a user data transmission unit operable to transmit the selected components 
and the operational contents of the selected component to a second stream correction 
apparatus (Fig. 12; page 22, paragraph 4; page 23, paragraph 1); a user data reception unit 
operable to receive a second component selected by a second user interface unit of the 
second stream correction apparatus and second operational contents of the second 
selected component (Fig. 12; page 22, paragraph 4; page 23, paragraph 1); and replacing 
motion data of the second selected component with data based on the second operational 
contents before outputting the corrected stream (page 23, paragraph 1; page 19, paragraph 
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3). At the time the invention was made, it would have been obvious to a person of 
ordinary skill in the art to modify the apparatus of Ubillos by incorporating a user data 
transmission unit, a user data reception unit, and replacing motion data of a second 
selected component as taught by Chang. The suggestion/motivation for doing so would 
have been because it would allow users to manipulate vide information over a distributed 
network, such as the Internet (page 6, paragraph 4). 

e. Referring to claim 44, Ubillos discloses a user interface operable to select an 
object or an object part to be operated by a user from among the plural components and 
to input operational contents of the selected object or object part (column 5, lines 33-35; 
column 8, lines 26-36). Ubillos does not expUcitly disclose a correction unit operable to 
generate a corrected stream by replacing the motion data of the selected object or object 
part with data based on the operational contents inputted by said user interface unit and to 
output the corrected stream. Chang discloses a correction unit operable to generate a 
corrected stream by replacing the motion data of the selected object or object part with 
data based on the operational contents and to output the corrected stream (page 16, 
paragraph 4; page 18, paragraph 2; page 20, paragraph 3; page 23, paragraph 3). At the 
time the invention was made it would have been obvious to a person of ordinary skill in 
the art to modify the apparatus of Ubillos by incorporating a correction unit as taught by 
Chang. The suggestion/motivation for doing so would have been because it would allow 
editing in the compressed domain which allows users to manipulate a specific object 
without having to fully decode the video (Chang, page 5, paragraph 1) and it would allow 
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users to manipulate video information over a distributed network (Chang, page 6, 
paragraph 4). 

£ Referring to claim 49, Ubillos does not explicitly disclose said computer graphics 
reproduction apparatus comprising a reproduction unit operable to decode the corrected 
stream, which is outputted from the correction unit to reproduce the computer graphics. 
Chang discloses said computer graphics reproduction apparatus comprising a 
reproduction unit operable to decode the corrected stream, which is outputted from the 
correction unit to reproduce the computer graphics (Fig, 12; page 23, paragraph 4). At the 
time the invention was made it would have been obvious to a person of ordinary skill in 
the art to modify the apparatus of Ubillos by incorporating a correction unit as taught by 
Chang, The suggestion/motivation for doing so would have been because it would allow 
editing in the compressed domain which allows users to manipulate a specific object 
without having to fully decode the video (Chang, page 5, paragraph 1) and it would allow 
users to manipulate video information over a distributed network (Chang, page 6, 
paragraph 4). 

g. Referring to claim 50, Ubillos does not explicitly disclose said computer graphics 
display apparatus comprising a display unit operable to real time display the computer 
graphics reproduced by said reproduction unit. Chang discloses disclose said computer 
graphics display apparatus comprising a display unit operable to real time display the 
computer graphics reproduced by said reproduction unit. (Fig. 12). At the time the 
invention was made it would have been obvious to a person of ordinary skill in the art to 
modify the apparatus of Ubillos by incorporating a correction unit as taught by Chang. 
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The suggestion/motivation for doing so would have been because it would allow editing 
in the compressed domain which allows users to manipulate a specific object without 
having to fully decode the video (Chang, page 5, paragraph 1) and it would allow users to 
manipulate video information over a distributed network (Chang, page 6, paragraph 4). 
h. Referring to claim 51, Ubillos does not expHcitly disclose a stream correction 
apparatus for correcting part of a first stream said stream correction apparatus comprising 
a user interface unit a correction unit; a user interface unit operable to select a component 
to be operated by a user from among the plural components and to input operational 
contents of the selected component (column 5, lines 33-35; column 8, lines 25-37); 
wherein said correction unit is operable to generate a corrected stream by replacing the 
motion data of the selected component with data based on the operational contents 
inputted and to output the corrected stream (Fig. 12, column 8, lines 25-37; column 7, 
lines 34-43). Ubillos does not expHcitly teach a stream transmission apparatus for 
transmitting a first stream in which motion data of plural components constituting 
computer graphics are packetized with time information in time sequence. Chang 
discloses a stream correction apparatus for correcting part of a first stream said stream 
correction apparatus comprising a user interface unit a correction unit (page 16, 
paragraph 4; page 18, paragraph 2; page 20, paragraph 3; page 23, paragraph 3); a stream 
transmission apparatus for transmitting a first stream in which motion data of plural 
components constituting computer graphics are packetized with time information in time 
sequence (Fig, 12; page 22, paragraph 4; page 23, paragraph 1). At the time the invention 
was made, it would have been obvious to a person of ordinary skill in the art to modify 
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the apparatus of Ubillos by incorporating a user data transmission unit, a user data 
reception unit, and replacing motion data of a second selected component as taught by 
Chang. The suggestion/motivation for doing so would have been because it would allow 
users to manipulate vide information over a distributed network, such as the Internet 
(page 6, paragraph 4). 

i. Referring to claim 52, Ubillos discloses selecting a component to be operated by a 
user from among the plural components (column 5, lines 33-35); inputting operational 
contents of the selected component (column 8, lines 25-37). Ubillos does not exphcitly 
disclose correcting the input stream by replacing the motion data of the selected 
component with data based on the inputted operational contents and outputting the 
corrected stream, Chang discloses correcting the input stream by replacing the motion 
data of the selected component with data based on the inputted operational contents and 
outputting the corrected stream (page 16, paragraph 4; page 18, paragraph 2; page 20, 
paragraph 3; page 23, paragraph 3). At the time the invention was made it would have 
been obvious to a person of ordinary skill in the art to modify the apparatus of Ubillos by 
incorporating a correction unit as taught by Chang. The suggestion/motivation for doing 
so would have been because it would allow editing in the compressed domain which 
allows users to manipulate a specific object without having to fully decode the video 
(Chang, page 5, paragraph 1) and it would allow users to manipulate video information 
over a distributed network (Chang, page 6, paragraph 4). 

j. Referring to claim 53, Ubillos discloses selecting a component to be operated by 
a user from among the plural components (column 5, lines 33-35); inputting operational 
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contents of the selected component (column 8, lines 25-37). Ubillos does not explicitly 
disclose correcting the input stream by replacing the motion data of the selected 
component with data based on the inputted operational contents; outputting the corrected 
stream and reproducing the computer graphics by decoding the outputted corrected input 
stream. Chang discloses correcting the input stream by replacing the motion data of the 
selected component with data based on the inputted operational contents; outputting the 
corrected stream and reproducing the computer graphics by decoding the outputted 
corrected input stream (page 16, paragraph 4; page 18, paragraph 2; page 20, paragraph 
3; page 23, paragraph 3). At the time the invention was made it would have been obvious 
to a person of ordinary skill in the art to modify the apparatus of Ubillos by incorporating 
a correction unit as taught by Chang. The suggestion/motivation for doing so would have 
been because it would allow editing in the compressed domain which allows users to 
manipulate a specific object without having to fully decode the video (Chang, page 5, 
paragraph 1) and it would allow users to manipulate video information over a distributed 
network (Chang, page 6, paragraph 4). 

k. Referring to claim 54, Ubillos discloses selecting a component to be operated by a 
user from among the plural components (column 5, lines 33-35); inputting operational 
contents of the selected component (column 8, lines 25-37). Ubillos does not explicitly 
disclose correcting the input stream by replacing the motion data of the selected 
component with data based on the inputted operational contents; outputting the corrected 
stream and reproducing the computer graphics by decoding the outputted corrected input 
stream. Chang discloses correcting the input stream by replacing the motion data of the 
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selected component with data based on the inputted operational contents; outputting the 
corrected stream and reproducing the computer graphics by decoding the outputted 
corrected input stream (page 16, paragraph 4; page 18, paragraph 2; page 20, paragraph 
3; page 23, paragraph 3). At the time the invention was made it would have been obvious 
to a person of ordinary skill in the art to modify the apparatus of Ubillos by incorporating 
a correction unit as taught by Chang. The suggestion/motivation for doing so would have 
been because it would allow editing in the compressed domain which allows users to 
manipulate a specific object without having to fiilly decode the video (Chang, page 5, 
paragraph 1) and it would allow users to manipulate video information over a distributed 
network (Chang, page 6, paragraph 4). 

1. Referring to claim 55, Ubillos discloses selecting a component to be operated by a 
user from among the plural components (column 5, lines 33-35); inputting operational 
contents of the selected component (column 8, lines 25-37). Ubillos does not explicitly 
disclose correcting the input stream by replacing the motion data of the selected 
component with data based on the inputted operational contents and outputting the 
corrected stream. Chang discloses correcting the input stream by replacing the motion 
data of the selected component with data based on the inputted operational contents and 
outputting the corrected stream (page 16, paragraph 4; page 18, paragraph 2; page 20, 
paragraph 3; page 23, paragraph 3). At the time the invention was made it would have 
been obvious to a person of ordinary skill in the art to modify the apparatus of Ubillos by 
incorporating a correction unit as taught by Chang. The suggestion/motivation for doing 
so would have been because it would allow editing in the compressed domain which 
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allows users to manipulate a specific object without having to fully decode the video 
(Chang, page 5, paragraph 1) and it would allow users to manipulate video information 
over a distributed network (Chang, page 6, paragraph 4). 

m. Referring to claim 56, Ubillos discloses selecting a component to be operated by a 
user from among the plural components (column 5, lines 33-35); inputting operational 
contents of the selected component (column 8, lines 25-37). Ubillos does not explicitly 
disclose correcting the input stream by replacing the motion data of the selected 
component with data based on the inputted operational contents; outputting the corrected 
stream and reproducing the computer graphics by decoding the outputted corrected input 
stream. Chang discloses correcting the input stream by replacing the motion data of the 
selected component with data based on the inputted operational contents; outputting the 
corrected stream and reproducing the computer graphics by decoding the outputted 
corrected input stream (page 16, paragraph 4; page 18, paragraph 2; page 20, paragraph 
3; page 23, paragraph 3). At the time the invention was made it would have been obvious 
to a person of ordinary skill in the art to modify the apparatus of Ubillos by incorporating 
a correction unit as taught by Chang. The suggestion/motivation for doing so would have 
been because it would allow editing in the compressed domain which allows users to 
manipulate a specific object without having to fully decode the video (Chang, page 5, 
paragraph 1) and it would allow users to manipulate video information over a distributed 
network (Chang, page 6, paragraph 4). 

n. Referring to claim 57, Ubillos discloses selecting a component to be operated by a 
user from among the plural components (column 5, lines 33-35); inputting operational 
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contents of the selected component (column 8, lines 25-37). Ubillos does not explicitly 
disclose correcting the input stream by replacing the motion data of the selected 
component with data based on the inputted operational contents; and outputting the 
corrected stream and displaying in real time, the reproduced computer graphics. Chang 
discloses correcting the input stream by replacing the motion data of the selected 
component with data based on the inputted operational contents; and outputting the 
corrected stream and displaying in real time, the reproduced computer graphics (page 16, 
paragraph 4; page 18, paragraph 2; page 20, paragraph 3; page 23, paragraph 3). At the 
time the invention was made it would have been obvious to a person of ordinary skill in 
the art to modify the apparatus of Ubillos by incorporating a correction unit as taught by 
Chang. The suggestion/motivation for doing so would have been because it would allow 
editing in the compressed domain which allows users to manipulate a specific object 
without having to fully decode the video (Chang, page 5, paragraph 1) and it would allow 
users to manipulate video information over a distributed network (Chang, page 6, 
paragraph 4). 



Claim Rejections - 35 USC §103 
1 . The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 
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2. Claims 40, 45, and 48 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Ubillos in view of Chang as applied to claims 39 and 44 above, and further in viev^ of U.S. 
Patent No. 5,288,993 to Bidiville et al. 

a. Referring to claim 40, Ubillos discloses the correction unit is further operable to 
correct the input stream by replacing the motion data with data based on the operational 
contents inputted by said user interface unit of the selected component before outputting 
the correction stream (Fig. 12; column 8, lines 25-37; column 7, lines 34-43). Ubillos 
does not explicitly disclose a data conversion unit operable to convert the operational 
contents into second data suited to the motion data of the selected component and to 
output the second data, Bidiville discloses a data conversion unit operable to convert 
operational contents into second data and to output the second data in place of the 
operational contents (column 2, lines 52-54). At the time the invention was made, it 
would have been obvious to a person of ordinary skill in the art to modify the apparatus 
of Ubillos by including a data conversion unit operable to convert the operational 
contents into second data and to output the second data in place of the operational 
contents as taught by Bidiville. The suggestion/motivation for doing so would have been 
because Ubillos teachings using a pointing device to input instructions to the apparatus 
(column 5, lines 16-22) and the data conversion unit of Bidiville overcomes the 
limitations (i.e., accuracy) of the mechanical elements associated with pointing devices 
(column 2, lines 27-30). 

b. Referring to claim 45, Ubillos discloses the correction unit is further operable to 
correct the input stream by replacing the motion data with data based on the operational 
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contents inputted by said user interface unit of the selected component before outputting 
the correction stream (Fig. 12; column 8, lines 25-37; column 7, Hnes 34-43). Ubillos 
does not explicitly disclose a data conversion unit operable to convert the operational 
contents into second data suited to the motion data of the selected component and to 
output the second data. Bidiville discloses a data conversion unit operable to convert 
operational contents into second data and to output the second data in place of the 
operational contents (column 2, lines 52-54). At the time the invention was made, it 
would have been obvious to a person of ordinary skill in the art to modify the apparatus 
of Ubillos by including a data conversion unit operable to convert the operational 
contents into second data and to output the second data in place of the operational 
contents as taught by Bidiville. The suggestion/motivation for doing so would have been 
because Ubillos teachings using a pointing device to input instructions to the apparatus 
(column 5, lines 16-22) and the data conversion unit of Bidiville overcomes the 
limitations (i.e., accuracy) of the mechanical elements associated with pointing devices 
(column 2, lines 27-30). 

c. Referring to claim 48, Ubillos does not expUcitly disclose said data conversion 
unit is operable to use a pre-taught neural network when converting the operational 
contents into data suited to the motion data of the selected object or object part. Bidiville 
discloses a data conversion unit is operable to use a pre-taught neural network when 
converting operational data (column 2, lines 49-55). At the time the invention was made, 
it would have been obvious to a person of ordinary skill in the art to modify the apparatus 
of Ubillos by including a data conversion unit which uses a pre-taught neural network to 
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convert the operational data as taught by Bidiville. The suggestion/motivation for doing 
so would have been to increase the speed of the conversion process. 
3. Claims 46 and 47 are rejected under 35 U.S.C. 103(a) as being unpatentable over Ubillos 
in view of Chang as appHed to claim 44 above in view of Bidiville fijrther in view of U.S. Patent 
No. 5,793,356 to Svancarek. 

a. Referring to claim 46, Ubillos does not expUcitly disclose said data conversion 
unit is operable to use tabled conversion data when converting the operational contents 
into data suited to the motion data of the selected object or object part. Bidiville discloses 
a data conversion unit (column 2, lines 52-54). Svancarek discloses using tabled 
conversion data when converting operational content (column 12, line 66 - column 13, 
line 17). At the time the invention was made, it would have been obvious to a person of 
ordinary skill in the art to modify the apparatus of Ubillos to incorporate a data 
conversion unit as taught by Bidiville and to use tabled conversion data as taught by 
Svancarek. The suggestion/motivation for doing so would have been because Ubillos 
teachings using a pointing device to input instructions to the apparatus (column 5, lines 
16-22) and the data conversion unit of Bidiville overcomes the limitations (i.e., accuracy) 
of the mechanical elements associated with pointing devices (column 2, lines 27-30) and 
using tabled conversion data increases the speed of the conversion process. 

b. Referring to claim 47, Ubillos does not expUcitly disclose used tabled key 
conversion data when converting the operational contents into data suited to the motion 
data of the selected object or object part. As noted above Svancarek discloses using 
tabled conversion data when converting operational content (column 12, line 66 - column 
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13, line 17), however Svancarek does not explicitly disclose interpolating the conversion 
data. At the time the invention was made, it would have been obvious to a person of 
ordinary skill in the art to further modify the apparatus of Ubillos by interpolating the 
conversion data. The suggestion/motivation for doing so would have been because it 
would allow values not exphcitly listed in the table to be converted. 

Conclusion 

4. Applicant's amendment necessitated the new ground(s) of rejection presented in this 
Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP § 706.07(a). 
Applicant is reminded of the extension of time policy as set forth in 37 CFR 1 .136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1 .136(a) will be calculated from the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the date of this 
final action. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Linzy McCartney whose telephone number is (703) 605-0745. 
The examiner can normally be reached on Mon-Friday (8:00AM-5: 30PM). 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Mark Zimmerman, can be reached at (703) 305-9798. 
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Any response to this action should be mailed to: 

Commissioner of Patents and Trademarks 
Washington, D.C. 20231 

or faxed to: 

(703) 872-9314 (for Technology Center 2600 only) 

Hand-delivered responses should be brought to Crystal Park II, 2121 Crystal Drive, Arlington, VA, Sixth Floor 
(Receptionist). 

Any inquiry of a general nature or relating to the status of this application or proceeding should be directed to the 
Technology Center 2600 Customer Service Office whose telephone number is (703) 306-0377. 

Itm 

July 24, 2003 



MAHHEW C. BELU 
SUPERVISORY PATENT EXAMINER 
TECHNOLOGY CENTER 2600 



